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ISOLATING  THE  C(»D>ONENTS  OF  INTELLIGENCE 


Robert  J.  Sternberg 
Yale  University 

Informed  educational  and  social  policy  decisions  require  Identifica- 
tion and  Isolation  of  the  components  of  Intelligence.  Recent  declines  in 
scores  on  college  admissions  tests,  for  example,  have  aroused  concern 
over  current  Instructional  procedures  and  policies.  A ^lue  ribbon  panel 
set  out  to  discover  just  why  scores  have  declined.  But  true  understanding 
of  why  scores  have  declined  requires  understanding  of  Just  what  It  Is  that 
has  declined,  and  this  understanding  requires  In  turn  the  Isolation  of  the 
components  that  constitute  what  we  believe  to  be  Intelligent  performance. 

In  a recent  volume  (Sternberg,  1977b),  I have  proposed  a method  called 
componentlal  analysis  that  provides  a means  to  Isolate  the  components  of 
Intelligent  performance.  The  method  was  described  In  detail,  and  then 
tested  ill  a series  of  experiments  on  reasoning  by  analogy.  The  experiments 
showed  the  success  of  the  method  In  Isolating  components  of  analogical  rea- 
soning. But  an  important  question  was  left  unanswered  by  this  early  work: 
Is  componentlal  analysis  generallzable  to  tasks  other  than  analogies? 

During  the  past  two  to  three  years,  I have  been  Investigating  the  general- 
ization of  the  methodology  to  other  tasks,  and  have  also  been  engaged  in 
extending  the  methodology  in  order  to  increase  its  flexibility  of  applica- 
tion. I remain  convinced  that  the  set  of  procedures  constituting  componen- 
tlal analysis  Is  Indeed  general,  and  that  It  Is  applicable  to  a wide  range 
of  problems  requiring  Intelligent  performance.  I would  like  to  present 
here  a synopsis  of  some  of  these  Investigations,  concentrating  on  how 
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componentlal  methodology  is  used  to  Isolate  the  components  of  Intelligence. 
1 will  first  sunmarize  briefly  the  structure  of  a componential  analysis. 
Then  1 will  describe  the  method  of  precuelng,  the  method  1 originally 
used  for  isolating  the  components  of  intelligence.  Finally,  1 will  de- 
scribe new  methods  1 have  used  that  have  also  been  successful  in  isolating 
these  components . 

Structure  of  Componential  Analysis 
In  its  barest  outline,  a componential  analysis  consists  of  a series 
of  Intensive  task  analyses  that,  in  combination,  form  the  basis  for  an 
extensive  task  analysis.  An  intensive  task  analysis  is  an  attempt  to 
understand  as  fully  as  possible  the  psychology  of  a single  task.  An 
extensive  task  analysis  is  an  attempt  to  integrate  the  findings  from  a 
series  of  intensive  task  analyses  that  together  analyze  some  domain  of 
tasks  (e.g. , analogical  reasoning,  deductive  reasoning,  perceptual  speed, 
recognition  memory) . We  shall  concern  ourselves  here  only  with  intensive 
task  analysis. 

Each  Intensive  analysis  consists  of  two  parts,  internal  validation 
and  external  validation.  Internal  val .datlon  is  an  attempt  to  decompose 
global  task  performance  into  underlying  component  processes . External 
validation  is  an  attempt  to  relate  the  identified  components  of  task  per- 
formance to  individual  differences  in  performance  on  external  tasks.  We 
shall  concern  ourselves  here  only  with  internal  validation.  Further  de- 
tails on  the  structure  of  componential  analysis  can  be  found  in  Sternberg 
(1977b,  1978). 

The  Original  Pre cueing  Method  of  Task  Decomposition 
In  the  original  method  of  precueing  (Sternberg,  1977b),  the  first  step 
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In  the  first  subtask  (which  Is  Identical  to  the  full  task),  the  sub- 
ject is  presented  with  a blank  field  (no  precueing)  in  the  first  part  of 
the  trial.  The  subject  indicates  when  he  or  she  is  ready  to  proceed,  and 
then  the  full  analogy  appears.  The  subject  solves  the  analogy,  and  then 
presses  a button  indicating  a response  of  (a)  or  (b).  In  the  second  sub- 
task, the  subject  receives  a large  subset  of  the  task.  The  first  part  of 
the  trial  consists  merely  of  precuelng  with  the  first  term  of  the  analogy. 
The  subject  presses  a button  to  indicate  that  this  term  has  been  processed, 
and  then  the  whole  analogy  appears  on  the  screen.  The  subject  solves  it, 
and  then  indicates  his  or  her  response.  Note  that  although  the  full 
analogy  was  presented  in  the  second  part  of  the  trial,  only  the  last  four 
terms  needed  to  be  processed,  since  the  first  term  had  been  preprocessed 
during  precueing.  The  third  subtask  involves  a smaller  subset  of  the 
task.  The  first  part  of  the  trial  consists  of  presentation  of  the  first 
two  terms  of  the  analogy;  the  second  part  consists  of  full  presentation. 

The  fourth  subtask  Involves  a very  small  subset  of  the  full  task  in  the 
second  part  of  the  trial.  The  first  part  of  the  trial  consists  of  pre- 
sentation of  the  first  three  terms  of  the  analogy;  the  second  part  consists 
of  full  presentation,  but  requires  processing  of  only  the  last  two  terms. 

The  task  decomposition  described  above  serves  to  separate  components 
of  information  processing  that  would  be  confounded  li  only  the  full  task 
were  presented.  In  order  to  see  why,  one  must  first  know  something  about 
the  proposed  theory  of  analogical  reasoning  (Sternberg,  1977a,  1977b). 
According  to  the  theory,  solution  of  an  analogy  requires  (a)  encoding  of 
each,  term  of  the  analogy,  (b)  inference  of  the  relation  between  the  first 
two  terms  of  the  analogy  ("Four  score  and  seven  years  ago"  is  a quotation 
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from  Lincoln),  (c)  mapping  of  the  relation  between  the  first  and  third 
terms  of  the  analogy  ("Four  score  and  seven  years  ago"  and  "I'm  not  a 
crook."  are  both  quotations),  (d)  application  of  the  relation  from  the 
third  term  to  the  answer  options  ("I'm  not  a crook"  is  a quotation  from 
Nixon,  not  Capone),  and  (e)  response  (the  correct  answer  is  "a").  Option- 
ally, a sixth  justification  process  may  be  used  to  justify  one  option  as 
superior  when  none  seem  to  be  exactly  correct.  Suppose  only  the  full 
task  were  presented  to  subjects.  Then  according  to  certain  information- 
processing  models  of  analogical  reasoning  (which  cannot  be  described  here 
for  lack  of  space)  under  the  general  theory,  (a)  encoding  and  response 
would  be  confounded,  since  response  is  constant  across  all  analogy  types 
(one  response  is  always  required) , and  encoding  is  also  constant  across 
all  analogy  types  (five  analogy  terms  always  need  to  be  encoded);  (b)  in- 
ference and  application  would  be  confounded,  since  the  relation  between 
the  third  term  and  the  correct  option  is  always  the  same  as  that  between 
the  first  two  terms.  But  precueing  permits  disentanglement  of  components 
by  selective  dropout  of  components  required  for  processing.  By  varying 
the  amount  of  encoding  required  for  the  various  subtasks,  the  method  of 
precueing  permits  separation  of  encoding  from  the  constant  response.  And 
by  eliminating  the  inference  component  from  the  third  and  fourth  subtasks 
(while  retaining  the  application  component),  it  becomes  possible  to  dis- 
tinguish inference  from  application.  Recall  that  in  these  two  sub tasks, 
the  first  two  terms  of  the  analogy  were  presented  during  precuelng,  so 


' 


that  inference  could  be  completed  before  the  full  analogy  was  presented. 

The  precueing  method  obviously  assumes  additivity  across  subtasks. 
Two  methods  of  testing  additivity  have  been  proposed  (Sternberg,  1977b), 
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although,  they  can  only  be  briefly  mentioned  here.  The  first  requires 
testing  of  interval  scores  for  simplicial  structure.  The  second  involves 
comparison  of  parameter  estimates  for  the  uncued  condition  alone  with 
those  for  all  the  conditions  combined.  The  data  from  three  experiments 
on  analogical  reasoning  showed  reasonable  conformity  to  the  assumption 
of  additivity.  More  importantly,  even  when  the  assumption  of  additivity 
was  violated  to  some  degree,  the  method  of  precueing  proved  to  be  robust, 
3d.elding  sensible  and  Informative  data  nevertheless.  The  method  was 
quite  successful  in  its  application  to  analogy  problems.  The  best  model 
under  the  theory  of  analogical  reasoning  accounted  for  92%,  86%,  and  80% 
of  the  variance  in  the  latency  data  for  experiments  using  People  Piece 
(schematic-picture),  verbal,  and  geometric  analogies. 

Linear  syllogisms.  The  method  of  precueing  has  also  been  applied  in 
two  experiments  on  linear  syllogisms,  or  three-term  series  problems 
(Sternberg,  Note  1).  In  the  first  experiment,  subjects  were  presented 
with  problems  such  as  "John  is  taller  than  Pete.  Pete  is  taller  than  Bill. 
Who  is  tallest?  John  Pete  Bill."  Order  of  names  was  counterbalanced. 

Trials  again  occurred  in  two  parts.  In  the  first  >art,  subjects  received 
either  a blank  field  or  the  two  premises  of  the  problem.  (A  third  condi- 
tion, involving  presentation  of  only  the  first  premise,  might  have  been 
used,  but  wasn't.)  In  the  second  part,  subjects  received  the  whole  pro- 
blem. In  each  trial,  subjects  indicated  when  they  were  ready  to  receive 
the  whole  item,  and  then  indicated  as  their  response  one  of  the  three  terms 
of  the  problem.  A possible  limitation  of  this  manner  of  presentation  is 
that  it  seems  to  force  serial  ordered  processing,  whereas  when  left  to 
their  own  devices,  subjects  might  process  the  problems  differently,  for  ex- 
ample, by  reading  the  question  first.  A second  experiment  was  therefore  done. 
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In  the  second  experiment,  the  same  type  of  problem  was  used,  except 
that  the  question  was  presented  first:  "Who  is  tallest?  John  is  taller 
than  Pete.  Pete  is  taller  than  Bill.  John  Pete  Bill."  Again,  order 
of  names  was  counterba? arced.  There  were  three  precueing  conditions.  In 
the  first,  a blank  field  was  presented  during  the  first  part  of  the  trial. 
In  the  second,  only  the  question  was  presented  during  the  first  part  of 
the  trial.  In  the  third,  the  question  and  the  premises  were  presented  in 
the  first  part  of  the  trial,  so  that  subjects  needed  in  the  second  part  of 
the  trial  to  discover  only  the  ordering  of  the  answer  options.  The  full 
problem  was  always  presented  in  the  second  part  of  the  trial. 

The  methodology  was  again  quite  successful.  The  best  model,  my  own 
mixed  model  (Sternberg,  Note  1),  accounted  for  98%  of  the  variance  in  the 
latency  data  from  the  first  experiment,  and  97%  of  the  variance  in  the 
latency  data  from  the  second  experiment.  In  these  experiments  (but  not  in 
the  analogy  experiments),  model  fits  were  substantially  lower  in  the  con- 
ditions comprising  the  full  problems  only:  81%  and  74%.  Worth  noting, 
however,  is  that  the  reliabilities  of  these  subsets  of  the  latency  data 
were  only  .86  and  .82,  meaning  that  even  here  most  of  the  reliable  variance 
was  accounted  for.  The  higher  fits  of  the  models  to  data  with  precueing 
were  due  to  disentanglement  of  encoding  from  response . When  only  full  pro- 
blems are  presented,  it  is  impossible  to  separate  premise  encoding  time 
from  response  time,  since  both  are  constant  over  problem  types:  There  are 
always  two  premises  and  one  response.  Separation  of  the  encoding  component 
substantially  Increased  the  variance  in  the  latency  data,  and  hence  the 
values  of  R^. 
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Other  problem  types.  The  method  of  precueing  has  also  been  applied 
in  the  presentation  of  classification,  series  completion,  and  topology 
problems.  In  the  classification  problems,  subjects  were  presented  with 
twD  groups  of  two  items  each,  and  a target  item.  The  subjects  had  to 
indicate  in  which  group  the  target  belonged.  For  example,  one  group 
might  be  "(a)  robin,  sparrow,"  the  other  "Cb)  haddock.,  flounder."  If 
the  target  were  "bluejay,"  the  correct  answer  would  be  (a).  Precueing 
was  accomplished  by  presenting  either  a blank,  field  in  the  first  part  of 
the  trial,  or  just  the  two  groups  of  items.  Further  precueing  might  have 
been  accomplished  by  presenting  just  one  group  of  items  in  the  first  part 
of  the  trial,  although  this  was  not  in  fact  done. 

In  the  series  completion  problems,  subjects  were  presented  with  a 
linear  ordering  that  they  then  had  to  complete,  for  example,  "infant,  child, 
adolescent,  (a)  adult,  Cb)  teenager."  Precueing  was  accomplished  by  pre- 
senting either  a blank  field  or  just  the  first  three  terms  of  the  item  in 
the  first  part  of  the  trial. 

In  the  topology  problems,  the  subject  was  presented  with  a picture  of 
a dot  embedded  in  a complex  geometric  drawing.  The  subject  was  also  pre- 
sented with  two  other  geometric  drawings,  neither  of  which  contained  a 
dot.  The  subject  had  to  indicate  in  which  of  the  two  drawings  at  the 
right  a dot  could  be  placed  so  that  it  met  the  same  constraints  as  the  dot 
at  the  left.  For  example,  if  the  dot  at  the  left  was  inside  a square,  out- 
side a circle,  and  below  a line,  then  the  subject  had  to  choose  the  single 
drawing  at  the  right  in  which  a dot  could  be  placed  that  met  the  same  con- 
straints. Precueing  was  accomplished  by  presenting  either  a blank  field 
or  just  the  picture  with  the  dot  in  the  first  part  of  the  trial. 
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Data  from  seven  experiments  using  these  three  types  of  items  with 
differing  kinds  of  content  (schematic-picture,  verbal,  geometric  for 
classifications  and  series  completions;  geometric  only  for  topologies) 
have  not  yet  been  fully  analyzed.  Preliminary  indications,  however,  are 
that  the  method  of  precueing  was  successful  in  each  case. 

Evaluation  of  method.  The  method  of  precueing  has  both  positive  and 
negative  aspects  associated  with  it.  On  the  positive  side,  (a)  it  per- 
mits disentanglement  of  components  that  otherwise  would  be  confounded; 

(b)  by  doing  so,  it  permits  comparison  of  models  that  otherwise  would  be 
indistinguishable;  (c)  it  increases  the  number  of  data  points  to  be 
modeled,  thereby  helping  to  guard  against  the  spurious  good  fit  that  can 
result  when  relatively  large  numbers  of  parameters  are  estimated  for 
relatively  small  numbers  of  observations;  (d)  it  requires  the  investigator 
to  specify  in  what  interval (s)  of  processing  each  mental  operation  takes 
place,  thereby  forcing  the  investigator  to  explicate  his  or  her  model  in 
considerable  detail;  (e)  it  provides  scores  for  performance  in  a series 
of  nested  processing  intervals,  rather  than  merely  for  the  total  task. 

On  the  negative  side,  (a)  the  method  requires  at  least  a semblance  of 
additivity  across  subtasks;  (b)  it  requires  use  of  tachistoscopic  or  com- 
puter equipment  to  present  each  trial;  (c)  it  requires  individual  testing; 
(d)  it  is  not  suitable  for  young  children  because  of  its  complexity.  In 
the  uses  to  which  the  method  has  been  put  so  far,  the  advantages  of  pre- 
cueing have  clearly  more  than  offset  its  limitations. 

New  Methods  of  Task  Decomposition 

During  the  past  two  years,  I have  extended  componential  methodology 
by  using  new  methods  of  task  decomposition.  I will  describe  these  methods 


in  the  present  section. 
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Method  of  Partial  Tasks 

In  the  method  of  partial  tasks,  complete  Items  are  presented  Involving 
either  a full  set  of  hypothesized  components  or  just  some  subset  of  these 
components . The  method  differs  from  the  method  of  precuelng  In  that  trials 
are  not  split  Into  two  parts.  Decomposition  Is  effected  with  unitary 
trials.  The  partial  and  full  tasks,  however,  are  assumed  to  be  addltlvely 
related,  as  In  the  method  of  precuelng. 

Linear  syllogisms.  The  method  of  partial  tasks  has  been  used  In  four 
experiments  on  linear  syllogisms  (Sternberg,  Note  1,  Note  2).  The  full 
task  consisted  of  the  standard  linear  syllogism  (three-term  series)  pro- 
blem as  described  earlier.  The  partial  task  consisted  of  a two-term 
series  problem,  for  example,  "John  is  taller  than  Pete.  Who  is  tallest?" 
(The  ungrammatical  superlative  was  used  in  the  question  to  preserve  uni- 
formity with  the  three-term  series  problems . ) The  mixed  model  of  linear 
syllogistic  reasoning  specified  the  component  processes  involved  in  both 
the  two  and  three-term  series  problems,  specifying  the  processes  involved 
in  the  former  as  a subset  of  the  processes  involved  in  the  latter.  The 
values  of  were  .97,  .97,  and  .97  with  all  items  considered,  and  .84, 

.88,  and  .84  with  only  three-term  series  items  considered.  Note  that  these 
values  are  quite  similar  to  those  obtained  ur.der  the  method  of  precuelng. 
Values  of  parameters  were  also  remarkably  similar,  with  two  exceptions 
(predicted^  for  reasons  that  cannot  be  described  here^by  the  mixed  model). 

Categorical  syllogisms.  The  method  of  partial  tasks  has  also  been 
applied  in  the  investigation  of  categorical  syllogisms  (Sternberg  & Turner, 
Note  3).  The  full  task  was  a standard  categorical  syllogism,  with  premises 
like  "All  B are  C.  Some  A are  B."  The  subject  was  also  presented  with  a 
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conclusion,  such  as  "All  A are  C,"  and  had  to  Indicate  whether  this  con- 
clusion was  definitely  true,  possibly  true,  or  never  true  of  the  premises. 
The  partial  task,  involved  presentation  of  only  a single  premise,  such  as 
"Some  A are  B. " The  subject  again  had  to  decide  whether  a conclusion, 
such  as  "Some  A are  B,"  was  definitely,  possibly,  or  never  true  of  the 
(in  this  case  single)  premise. 

Whereas  the  primary  dependent  variable  of  interest  in  the  previously 
described  experiments  was  solution  latency,  the  primary  dependent  variable 
in  this  experiment  was  response  choice.  The  preferred  model  of  syllogistic 
reasoning,  the  transitive-chain  theory  (Guyote  & Sternberg,  Note  4),  ac- 
counted for  96%  of  the  variance  in  the  response-choice  data  from  the  full 
task,  and  96%  of  the  variance  in  the  response-choice  data  from  the  partial 
task.  Fits  were  not  computed  for  the  combined  data,  since  in  this  par- 
ticular experiment  we  happened  to  be  Interested  in  the  full  task  as  an 
"encoding  plus  combination  task"  and  in  the  partial  task  as  an  "encoding 
only"  task.  These  data  indicate  not  only  that  the  method  of  partial  tasks 
can  be  applied  successfully  to  categorical  syllogisms,  but  that  it  can  be 
applied  to  response-choice  as  well  as  latency  data. 

Evaluation  of  method.  This  method  seems  to  share  all  of  the  advan- 
tages of  the  method  of  precueing,  but  only  one  of  its  disadvantages,  namely, 
the  assumption  of  additivity,  in  this  case  between  the  partial  and  the 
full  task.  The  method  of  partial  tasks  therefore  seems  to  be  the  pre- 
ferred method  when  one  has  the  option  of  using  either  of  the  two  methods. 

Two  additional  points  need  to  be  considered,  however.  First,  additivity 
may  be  obtained  across  precueing  conditions  but  not  from  partial  to  full 
tasks,  or  vice  versa.  Thus,  some  amount  of  pilot  testing  may  be  needed  to 
determine  which  method  is  more  likely  to  yield  additivity  across  conditions. 
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Second,  some  tasks  are  decomposable  by  either  method,  but  others  may  be 
decomposable  only  by  one  or  the  other  method.  I have  found  the  method 
of  precuelng  applicable  to  more  tasks  than  the  method  of  partial  tasks, 
although  the  differential  applicability  may  be  a function  of  the  partic- 
ular tasks  I have  investigated.  In  any  case,  the  decision  of  which 
method  to  use  can  be  made  only  after  a careful  consideration  of  task 
demands  and  decomp osability.  In  some  cases,  the  investigator  may  choose 
to  use  both  methods,  as  in  Sternberg  (Note  1). 

Method  of  Stem-Splitting 

Analogies.  The  method  of  stem-splitting  involves  items  requiring 
the  same  number  of  information-processing  components,  but  different  num- 
bers of  executions  of  the  various  components.  It  combines  features  of  the 
method  of  precueing  with  those  of  the  method  of  partial  tasks.  So  far, 
the  method  has  been  applied  only  to  verbal  analogies.  Using  the  method 
of  stem-splitting , we  presented  verbal  analogies  in  three  different  for- 
mats (Sternberg  & Nigro,  Note  5): 

1.  red  : blood  ::  white  : (a)  color 

(b)  snow 

2.  red  : blood  (a)  white  : snow 

(b)  brown  : color 

3.  red  ; (a)  blood  white  : snow 

(b)  brick  : : brown  : color 

The  number  of  answer  options  was  allowed  to  vary  from  two  to  four  for 
individual  items.  Consider  how  the  different  item  types  involve  different 
numbers  of  executions  of  the  same  components.  The  first  item  requires 
encoding  of  five  terms,  inference  of  one  relation,  napping  of  one  relation, 
application  of  two  relations,  and  one  response.  The  second  item  requires 

1 

encoding  of  six  terms,  inference  of  one  relation,  mapping  of  two  relations,  I 
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application  of  two  relations,  and  one  response.  The  third  Item  requires 
encoding  of  seven  terms,  inference  of  two  relations,  mapping  of  two  re- 
lations, application  of  two  relations,  and  one  response.  (In  each  case, 
exhaustive  processing  of  the  Item  Is  assumed.)  Varying  the  number  of 
answer  options  also  creates  further  variance  In  the  numbers  of  operations 
required. 

This  method  has  been  used  with  children  as  young  as  the  third  grade 
level  and  as  old  as  the  college  level.  The  data  from  the  experiment  have 
not  yet  been  fully  analyzed,  although  preliminary  Indications  are  most 
encouraging.  Even  the  youngest  children  understood  the  task,  and  per- 
formed at  a level  well  above  chance.  Indications  are  that  we  will  be 
able  to  account  for  over  80%  of  the  variance  in  the  data  at  the  higher 
(ninth  grade  and  adult)  levels,  and  possibly  for  as  much  of  the  variance 
in  the  data  for  the  younger  levels  as  well. 

Evaluation  of  method.  This  method  has  barely  been  tried,  and  so  I 
am  not  yet  in  a position  to  evaluate  fully  its  usefulness.  On  the  positive 
side,  (a)  it  could  be  (although  has  not  yet  been)  used  for  group  testing 
in  conjunction  with  booklets  of  the  kind  described  in  the  next  section, 

(b)  it  requires  no  special  equipment  to  administer  items,  (c)  it  is  fea- 
sible with  young  children,  and  (d)  it  seems  to  create  a certain  added 
interest  to  the  problems  for  the  subjects.  On  the  negative  side,  (a)  the 
success  of  the  method  has  not  yet  been  adequately  demonstrated,  (b)  the 
generality  of  the  method  to  problems  other  than  analogies  has  not  yet  been 
shown,  and  (c)  the  method  seems  more  likely  than  the  preceding  ones  to 
generate  special  strategies  that  are  inapplicable  to  standard  (complete) 
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Method  of  Systematically  Varied  Booklets 

Analogies.  In  previous  methods,  the  unit  of  presentation  was  the 
single  Item.  In  this  method,  the  unit  of  presentation  Is  the  booklet. 

In  previous  methods,  subjects  were  given  as  long  as  they  needed  to  com- 
plete each  Individual  Item.  In  this  method,  subjects  are  given  a fixed 
amount  of  time  to  complete  as  many  Items  as  they  can  within  a given 
booklet.  The  number  of  Items  In  the  booklet  should  exceed  the  number  of 
Items  that  subjects  can  reasonably  be  expected  to  complete  In  the  given 
time  period.  The  key  to  the  method  Is  that  all  Items  within  a given 
booklet  are  homogeneous  with  respect  to  the  theory  or  theories  being 
tested.  Although  the  same  Items  are  not  repeated,  each  Item  serves  as 
a replication  with  respect  to  the  sources  of  difficulty  specified  by  the 
theory.  Although  Items  within  a given  booklet  are  homogeneous.  Items  are 
heterogeneous  across  booklets.  In  this  method,  specifications  of  the 
Items  within  a booklet  are  varied  In  the  same  way  that  specifications  of 
single  Items  are  varied  In  the  preceding  methods. 

The  method  of  systematically  varied  booklets  has  been  employed  only 
with  two  types  of  schematic-picture  analogies  (Sternberg  & Rif kin.  Note  6). 
In  the  two  experiments  done  so  far,  the  method  has  been  used  successfully 
with  children  as  young  as  grade  2 and  as  old  as  college  age.  Subjects  at 
each  grade  level  were  given  64  seconds  In  which  to  solve  the  16  analogies 
contained  In  each  booklet.  Independent  variables  were  numbers  of  schematic 
features  changed  between  the  first  and  second  analogy  terms,  first  and 
third  analogy  terms,  and  the  first  and  second  analogy  answer  options. 

Items  within  a given  booklet  were  Identical  In  each  of  these  respects. 

Three  dependent  variables  were  derived  from  the  raw  data.  The  first  was 
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latency  for  correctly  answered  items,  obtained  by  dividing  64  by  the  number 
of  items  correctly  completed.  This  measure  takes  into  account  both  quality 
and  quantity  of  performance.  The  second  dependent  variable  was  latency 
for  all  answered  items,  obtained  by  dividing  64  by  the  number  of  items 
completed,  whether  they  were  completed  correctly  or  incorrectly.  This 
measure  takes  into  account  only  quantity  of  performance.  The  third  de- 
pendent variable  was  error  rate,  obtained  by  dividing  the  number  of  items 
answered  at  all.  This  measure  takes  into  account  only  quality  of  perfor- 
mance. 

In  a first  experiment,  model  fits  (R  ) for  the  best  model  were  .91, 
.95,  .90,  and  .94  for  latencies  of  correct  responses  at  grades  2,  4,  6, 
and  college;  they  were  .87,  .94,  .93,  and  .94  for  latencies  of  all  re- 
sponses at  each  grade  level;  and  they  were  .26,  .86,  .52,  and  .65  for  error 
rates  at  each  level.  The  fits  for  errors,  although  lower  than  for  the 
latencies,  were  almost  at  the  same  levels  as  the  reliabilities  of  each  of 
the  sets  of  data,  indicating  that  only  slightly  better  fits  could  possibly 
have  been  obtained.  Model  fits  in  a second  experiment  were  slightly  lower 
than  in  the  first  experiment,  but  so  were  the  reliabilities  of  the  data. 

Evaluation  of  method.  The  method  of  systematically  varied  booklets 
has  three  distinct  advantages  and  two  distinct  disadvantages.  Its  advan- 
tages are  that  (a)  it  is  practical  even  with  very  young  children,  (b)  it 
requires  no  special  equipment  for  test  administration,  and  (c)  it  is 
adopted  to  group  testing.  Its  disadvantages  are  that  (a)  it  is  not  pos- 
sible to  obtain  a pure  measure  of  time  spent  only  on  items  answered  cor- 
rectly (or  incorrectly),  since  times  are  recorded  only  for  booklets,  not 
for  individual  items,  and  that  (b)  the  method  is  not  particularly  well 
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suited  to  disentangling  components.  In  some  of  the  models  tested,  for 
example,  encoding  and  response,  and  inference  and  application,  were  con- 
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Method  of  Complete  Tasks  (Standard  Method  of  Presentation) 

The  method  of  complete  tasks  is  simply  the  standard  method  of  pre- 
senting only  the  complete  item.  It  is  suited  to  items  in  which  no  con- 


foundings  of  components  occur. 

Categorical  syllogisms.  The  method  of  complete  tasks  was  used  in  the 
presentation  of  categorical  syllogisms  (Guyote  & Sternberg,  Note  4).  In 
a first  experiment,  subjects  were  presented  with  syllogistic  premises, 
such  as  "All  B are  C.  All  A are  B,"  plus  a set  of  four  possible  conclu- 
sions (called  A,  E,  I,  and  0 in  the  literature  on  syllogistic  reasoning), 
"All  A are  C.  No  A are  C.  Some  A are  C.  Some  A are  not  C."  plus  the 
further  conclusion,  "None  of  the  above."  Subjects  had  to  choose  the  pre- 
ferred conclusion  from  among  the  five.  In  a second  experiment,  concrete 
rather  than  abstract  terms  were  used.  Premises  were  either  factual  (No 
cottages  are  skyscrapers),  counterfactual  (No  milk  cartons  are  containers), 
or  anomalous  (No  headphones  are  planets).  In  a third  experiment,  the 
quantifiers  "most"  and  "few"  were  used  instead  of  "some."  In  a fourth 
experiment,  premises  were  presented  in  the  form  "All  A are  B.  X is  an  A," 
and  subjects  were  asked  simply  to  judge  whether  a conclusion  such  as  "X  is 
a B"  was  valid  or  invalid.  Our  transitive-chain  model  outperformed  the 
other  models  of  response  choice  to  which  it  was  compared,  yielding  values 
of  of  .97  for  abstract  content,  .91  for  concrete  factual  content,  .92 
for  concrete  counterfactual  content,  .89  for  concrete  anomalous  content, 

.94  when  "most"  and  "few"  were  substituted  for  "some,"  and  .97  for  the 
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simpler  syllogisms  requiring  only  a valid-invalid  judgment.  Latency  models 
were  also  fit  to  some  of  the  data,  with  excellent  results. 

One  of  the  assumptions  of  the  preferred  transitive-chain  model  Is 
that  encoding  is  flawless:  Errors  are  hypothesized  to  be  made  in  other 
stages  of  syllogistic  reasoning.  Modeling  of  the  data  via  the  method  of 
complete  tasks  does  not  permit  a direct  test  of  this  assumption.  The 
method  of  partial  tasks  did  permit  such  a test,  however,  and  the  Stemberg- 
Tumer  (Note  3)  data  described  earlier  provided  support  for  this  assumption 
when  encoding  was  separated  from  subsequent  stages  of  reasoning. 

Conditional  syllogisms.  The  method  of  complete  tasks  was  also  used 
in  testing  the  transitive-chain  model  on  conditional  syllogisms  of  the 
form  "If  A then  B.  A.  Therefore,  B."  The  subject's  task  was  to  evaluate 
the  conclusion  as  either  valid  or  invalid.  The  model  accounted  for  95%  of 
the  variance  in  the  response-choice  data. 

Evaluation  of  method.  The  main  advantages  of  this  method  are  that 
(a)  it  is  the  simplest  of  the  methods  described,  and  (b)  it  does  not  re- 
quire any  assumptions  about  additivity  across  conditions  of  decomposition. 
The  main  disadvantage  of  the  method  Is  that  In  many  if  not  most  tasks.  In- 
formation-processing  components  will  be  confounded.  These  confoundlngs 
can  lead  to  serious  consequences,  as  discussed  in  Sternberg  (1977b).  The 
method  is  the  method  of  choice  only  when  it  is  possible  for  it  to  disen- 
tangle all  component  processes  of  Interest. 

Conclusions 

The  primary  purpose  of  this  article  was  to  show  the  generalizablllty 
of  the  procedures  of  componentlal  analysis  to  tasks  beyond  the  analogies 
tasks  to  which  the  method  was  originally  applied  (Sternberg,  1977a,  1977b). 
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In  the  course  of  demonstrating  the  generallzablllty  of  the  method,  some  new 
procedures  for  task  decomposition  were  briefly  noted  and  explicated.  The 
focus  in  these  explications  vaa  on  the  experimental  procedures  used,  rather 
than  on  the  substantive  theories  tested  or  the  quantification  of  these 
theories.  Substantive  and  quantitative  details  can  be  found  in  the  orig- 
inal articles.  The  data  for  a rather  wide  variety  of  reasoning  tasks 
Indicate  that  componential  analysis  is  Indeed  applicable  to  tasks  with 
varying  degrees  of  resemblance  to  analogies,  ranging  from  tasks  that  are 
quite  similar  (for  example,  series  completions)  to  tasks  that  are  quite 
different  (for  example,  categorical  syllogisms). 

It  was  not  possible  in  this  particular  article  to  demonstrate  the 
range  of  advantages  that  accrued  from  componential  decomposition  of  tasks, 
and  from  the  full  set  of  procedures  involving  intensive  and  extensive 
task  analysis,  and  Internal  and  external  validation  of  given  tasks.  But 
my  collaborators  and  I believe  that  the  full  set  of  procedures  has  rewarded 
us  with  insights  that  seem  not  to  be  available  through  standard  differential 
and  Information-processing  methods  of  model  testing.  We  therefore  believe 
that  componential  analysis  merits  further  exploration  both  in  laboratory 
and  practical  settings.  We  like  to  visualize  the  day  in  the  future  when 
It  might  be  possible  to  construct  tests  of  intelligence  that  derive  from 
rational  componential  theories  of  abilities,  rather  than  from  procedures 
that  while  empirically  sound,  may  be  theoretically  vacuous. 
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Naval  Research  Laboratory 
Code  2627 

Washington,  DC  20390 


1 W.  Cary  Thooson 

Naval  Ocean  Systems  Center 
Code  7132 

San  Diego,  CA  92152 


II  OFFICE  OF  CIVILIAN  PERSONNEL 
(CODE  26) 

DEPT.  OF  THE  NAVY 
WASHINGTON,  DC  20390 

1 JOHN  OLSEN 

CHIEF  OF  NAVAL  EDUCATION  & 
TRAINING  SUPPORT 
PENSACOLA,  FL  32509 

1 Office  of  Naval  Research 
Code  200 

Arlington,  VA  22217 

1 Scientific  Director 

Office  of  Naval  Research 
Scientific  Liaison  Group/Tokyo 
American  Embassy 
APO  San  Francisco,  CA  96503 


1 DR.  H.M.  WEST  III 

DEPUTY  ADCNO  FOR  CIVILIAN  PLANNING 
AND  PROGRAMMING 
RM.  2625,  ARLINGTON  ANNEX 
WASHINGTON,  DC  20370 

1 DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
LAWRENCE,  KANSAS  66044 

1 DR.  MARTIN  F.  WISKOFF 

NAVY  PERSONNEL  R&  D CENTER 
SAN  DIEGO,  CA  92152 


1 SCIENTIFIC  ADVISOR  TO  THE  CHIEF 
OF  NAVAL  PERSONNEL 
NAVAL  BUREAU  OF  PERSONNEL  (PERS  OR) 
RM.  4410,  ARLINGTON  ANNEX 
WASHINGTON,  DC  20370 


DR.  RICHARD  A.  POLLAK 
ACADEMIC  COMPUTING  CENTER 
U.S.  NAVAL  ACADEMY 
ANNAPOLIS,  MD  21402 

A.  A.  SJOHOLM 
TECH.  SUPPORT,  CODE  201 
NAVY  PERSONNEL  R&  D CENTER 
SAN  DIEGO,  CA  92152 

CDR  Charles  J.  Theisen,  JR.  MSC,  USN 
Head  Human  Factors  Engineering  Div. 
Naval  Air  Development  Center 
Warminster,  PA  18974 
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1 ARI  Field  Unit-Leavenworth 
P.O.  Box  3122 

Ft.  Leavenworth,  KS  66027 

1 Commandant 

O.S.  Army  Infantry  School 

Ft.  Banning,  GA  31905 

Attn:  ATSH-I-V-IT  (Cpt.  Hinton) 

1 DR.  JAMES  BAKER 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1 DR.  RALPH  CANTER 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1 DR.  RALPH  DUSEK 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1 Dr.  Milton  S.  Katz 

Individual  Training  & Skill 
Evaluation  Technical  Area 
U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1 DR.  JAMES  L.  RANEY 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1 Dr.  J.  E.  Uhlaner 

Chief  Psychologist,  US  Army 
Army  Research  Institute 
6933  Hector  Road 
McLean,  VA  22101 

1 Dr.  Joseph  Ward 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


Air  Force 


1 Air  Force  Human  Resources  Lab 
AFHRL/PED 

Brooks  AFB,  TX  78235 

1 Air  University  Library 
AUL/LSE  76/1*  U3 
Maxwell  AFB,  AL  36112 

1 DR.  G.  A.  ECKSTRAND 
AFHRL/AS 

WRIGHT-PATTERSON  AFB,  OH  1*5433 

1 Dr.  Alfred  R.  Fregly 
AFOSR/NL,  Bldg.  410 
Bolling  AFB,  DC  20332 

1 CDR.  MERCER 

CNET  LIAISON  OFFICER 
AFHRL/FLYING  TRAINING  DIV. 
WILLIAMS  AFB,  AZ  85224 

1 Personnel  Analysis  Division 
HQ  USAF/DPXXA 
Washington,  DC  20330 

1 Research  Branch 
AFMPC/DPMYP 

Randolph  AFB,  TX  78148 

1 Dr.  Marty  Rockway  (AFHRL/TT) 

Lowry  AFB 
Colorado  80230 

1 Major  Wayne  S.  Sellman 
Chief,  Personnel  Testing 
AFMPC/DPMYPT 
Randolph  AFB,  TX  78148 

1 Brian  K.  Waters,  MaJ.,  USAF 

Chief,  Instructional  Tech.  Branch 
AFHRL 

Lowry  AFB,  CO  80230 
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Marines 


1 DR.  A.L.  SLAFKOSKY 

SCIENTIFIC  ADVISOR  (CODE 
HQ,  U.S.  MARINE  CORPS 
VASHINGTON,  DC  20380 


CoastCuard 


1 MR.  JOSEPH  J.  COWAN,  CHIEF 
RD-1)  PSYCHOLOGICAL  RESEARCH  (G-P 

U.S.  COAST  GUARD  HQ 
WASHINGTON,  DC  20590 
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Other  DoD 


Civil  Govt 


12  Defense  Documentation  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  223 IM 
Attn:  TC 

1 Military  Assistant  for  Human  Resources 
Office  of  the  Director  of  Defense 
Research  & Engineering 
Room  3D129,  the  Pentagon 
Washington,  DC  20301 

1 Dr.  Harold  F.  O'Neil,  Jr. 

Advanced  Research  Projects  Agency 
Cybernetics  Technology,  Rm.  623 
ItOO  Wilson  Blvd. 

Arlington,  VA  22209 

1 Director,  Research  A Data 
OSD/MRA&L  (Rm.  3B919) 

The  Pentagon 
Washington,  DC  20301 

1 Mr.  Fredrick  W.  Suffa 
MPP  (A&R) 

2B269 

Pentagon 

Washington,  D.C.  20301 

1 DR.  ROBERT  YOUNG 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
1400  WILSON  BLVD. 

ARLINGTON,  VA  22209 


1 Or.  Lorraine  D.  Eyde 
Personnel  RAD  Center 
U.S.  Civil  Service  Commission 
1900  EStreet  NW 
Washington,  D.C.  20415 

1 Dr.  William  Gorham,  Director 
Personnel  RAD  Center 
U.S.  Civil  Service  Commission 
1900  E Street  NW 
Washington,  DC  20415 

1 Dr.  H.  Wallace  Sinaiko,  Director 

Manpower  Research  A Advisory  Service 
Smithsonian  Institution 
801  N.  Pitt  Street 
Alexandria,  VA  22314 

1 Dr.  Thomas  G.  Stlcht 
Basic  Skills  Program 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1 Dr.  Vern  W.  Urry 

Personnel  RAO  Center 
U.S.  Civil  Service  Commission 
1900  E Street  NW 
Washington,  DC  20415 

1 C.S.  WINIEWICZ 

U.S.  CIVIL  SERVICE  COMMISSION 
REGIONAL  PSYCHOLOGIST 
230  S.  DEARBORN  STREET 
CHICAGO,  IL  60604 


1 Dr.  Joseph  L.  Young,  Director 
Memory  A Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 
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Non  Govt 


1 PROP.  EARL  A.  ALLUISI 
DEPT.  OF  PSYCHOLOGY 
CODE  287 

OLD  DOMINION  UNIVERSITY 
NORFOLK,  VA  23508 

1 Dr.  John  R.  Anderson 
Dept,  of  Psychology 
Yale  University 
New  Haven,  CT  06520 

1 MR.  SAMUEL  BALL 

EDUCATIONAL  TESTING  SERVICE 
PRINCETON,  NJ  08540 


Non  Govt 


1 Dr.  Allan  M.  Collins 

Bolt  Beranek  & Newman,  Inc. 
50  Moulton  Street 
Cambridge,  Ma  02138 

1 Dr.  Meredith  Crawford 
5605  Montgomery  Street 
Chevy  Chase,  MD  20015 

1 OR.  RENE  V.  DAWIS 
DEPT.  OF  PSYCHOLOGY 
UNIV.  OF  MINNESOTA 
75  E.  RIVER  RD. 

MINNEAPOLIS,  MN  55455 


4 


1 Dr.  Gerald  V.  Barrett 
Dept,  of  Psychology 
University  of  Akron 
fkron,  OH  44325 

1 Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
600  Jay  Street 
Sacramento,  CA  95819 

1 Dr.  John  Seeley  Brown 

Bolt  Beranek  & Newman,  Inc. 
50  Moulton  Street 
Cambridge,  NA  02138 


1 Dr.  Ruth  Day 

Center  for  Advanced  Study 
in  Behavioral  Sciences 
202  Junlpero  Serra  Blvd. 
Stanford , CA  94305 

1 Dr.  Marvin  D.  Dunnette 
N492  Elliott  Hall 
Dept,  of  Psychology 
Unlv.  of  Minnesota 
Minneapolis,  MN  55455 

1 ERIC  Facility-Acquisitions 
4833  Rugby  Avenue 
Bethesda,  MD  20014 


1 DR.  VICTOR  BUNDERSON 

INSTITUTE  FOR  COMPUTER  USES 
IN  EDUCATION/355  EDLC 
BRIGHAM  YOUNG  UNIVERSITY 
PROVO,  UTAH  84601 

1 Dr.  John  Carroll 
Psychometric  Lab 
Unlv.  of  No.  Carolina 
Davie  Hall  013A 
Chapel  Hill,  NC  27514 

1 Dr.  Norman  Cliff 
Dept,  of  Psychology 
Unlv.  of  So.  California 
University  Park 
Loa  Angeles,  CA  90007 


1 MAJOR  I.  N.  EVONIC 

CANADIAN  FORCES  PERS.  APPLIED  RESEARCH 
1107  AVENUE  ROAD 
TORONTO,  ONTARIO,  CANADA 

1 Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 

P.O.  Box  168 

Iowa  City,  lA  52240 

1 Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 
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Hon  Govt 


1 Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organ 
8555  Sixteenth  Street 
Silver  Spring,  MD  20910 

1 Dr.  John  R.  Frederiksen 
Bolt  Beranek  & Newman 
50  Moulton  Street 
Cambridge,  MA  02138 

1 DR.  ROBERT  GLASER 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1 DR.  JAMES  G.  GREENO 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1 Dr.  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 

1 DR.  LAWFSNCE  B.  JOHNSON 

UHRENCE  JOHNSON  A ASSOC.,  INC. 
SUITE  502 
2001  S STREET  NW 
WASHINGTON,  DC  20009 

1 Dr.  Arnold  F.  Kanarick 
Honeywell,  Inc. 

2600  Ridgeway  Pkwy 
Minneapolis,  MN  55413 

1 Dr.  Roger  A.  Kaufman 
203  Dodd  Hall 
Florida  State  Univ. 

Tallahassee,  FL  32306 

1 Or.  Steven  W.  Keele 
Dept,  of  Psychology 
University  of  Oregon 
Eugene,  OR  97403 

L 


1 Dr.  Ezra  S.  Krendel 
Wharton  School, DH/DC 
University  of  Pennsylvania 
Philadelphia,  PA  19174 

1 LCOL.  C.R.J.  UFLEUR 
PERSONNEL  APPLIED  RESEARCH 
NATIONAL  DEFENSE  HQS 
101  COLONEL  BY  DRIVE 
OTTAWA,  CANADA  K1A  0K2 

1 Dr.  Frederick  M.  Lord 

Educational  Testing  Service 
Princeton,  NJ  08540 

1 Dr.  Robert  R.  Mackle 

Human  Factors  Research,  Inc. 

6780  Cortona  Drive 
Santa  Barbara  Research  Pk. 

Goleta,  CA  93017 

1 Dr.  Richard  B.  Millward 
Dept,  of  Psychology 
Hunter  Lab. 

Brown  University 
Providence,  RI  82912 

1 Richard  T.  Mowday 

College  of  Business  Administration 
University  of  Oregon 
Eugene,  OR  97403 

1 Dr.  Donald  A Norman 

Dept,  of  Psychology  C-009 
Univ.  of  California,  San  Diego 
U Jolla,  CA  92093 

1 Dr.  Melvin  R.  Novick 
Iowa  Testing  Programs 
University  of  Iowa 
Iowa  City,  lA  52242 

1 MR.  LUIGI  PETRULLO 

2431  N.  EDGEWOOD  STREET 
ARLINGTON,  VA  22207 
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Non  Govt 


1 DR.  STEVEN  M.  PINE 
N660  ELLIOTT  HALL 
UNIVERSITY  OF  MINNESOTA 
75  E.  RIVER  ROAD 
MINNEAPOLIS,  MN  55U55 

1 DR.  PETER  POLSON 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  COLORADO 
BOULDER,  CO  80302 

1 MIN.  RET.  M.  RAUCH 
P II  A 

BUNDESMINISTERIUM  DER  VERTEIDIGUNG 
POSTFACH  161 
53  BONN  1.  GERMANY 

1 Dr.  Mark  D.  Reckase 

Educational  Psychology  Dept. 
University  of  Missouri-Columbia 
12  Hill  Hall 
Columbia,  MO  65201 

1 Dr.  Joseph  W.  Rigney 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
3717  South  Hope  Street 
Los  Angeles,  CA  90007 

1 Dr.  Andrew  M.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NU 
Washington,  DC  20007 

1 Dr.  Leonard  L.  Rosenbaum,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1 PROP.  FUMIKO  SAMEJIMA 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  TENNESSEE 
INOXVILLE,  TN  37916 

1 Dr.  Benjamin  Schneider 
Dept,  of  Psychology 
Univ.  of  Maryland 
College  Park,  MD  207A2 


1 DR.  VALTER  SCHNEIDER 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  ILLINOIS 
CHAMPAIGN,  IL  61820 

1 Dr.  Lyle  Schoenfeldt 
School  of  Management 
Rensselaer  Polytechnic  Institute] 
Troy,  NY  12181 

1 Dr.  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  9^305 

1 Cr.  C.  Harold  Stone 
1428  Virginia  Avenue 
Glendale,  CA  91202 

1 DR.  PATRICK  SUPPES 
DEPT.  OF  PSYCHOLOGY 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

1 Dr.  Kikuml  Tatsuoka 

Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

1 Dr.  Benton  J.  Underwood 
Dept,  of  Psychology 
Northwestern  University 
Evanston,  IL  60201 

1 Dr.  Robert  Vineberg 
HumRRO/Western  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 

1 DR.  THOMAS  WALLSTEN 

PSYCHOMETRIC  LABORATORY 
DAVIE  HALL  013A 
UNIVERSITY  OF  NORTH  CAROLINA 
CHAPEL  HILL,  NC  27514 
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1 Dr.  David  J.  Weiss 
■660  Elliott  Hall 
University  of  Minnesota 
75  B.  River  Road 
Minneapolis,  MN  55455 

1 DR.  KEITH  WESCOURT 
DBPT.  OF  PSYCHOLOGY 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 


